Disaster-Relief Training System Using Augmented Reality and Voice Input Triage

When a large disaster happens, health care workers need to determine the priority of medical treatment and perform triage. In order to carry out emergency lifesaving activities at an actual disaster site quickly and accurately, frequent training is very important. However, current training has issues such as cost, many time and effort to prepare, as well as not being able to consider changes of patient’s vital signs. In addition, they cannot use any hands while writing paper tags or using PDAs, so it is difficult to perform necessary medical treatment in parallel. In this study, we propose triage training system where health care workers get patient information through a monocular HMD (Head Mount Display) and perform triage via voice input, so their hands are free to conduct necessary treatment even while doing triage. Moreover our system can reproduce the situation through the HMD by superimpose dynamic information about patients onto real space, and allow sharing the training status. The evaluation shows that our system enables to perform triage quickly and accurately with health care workers’ hands free and make disaster-relief trainings more meaningful.